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ABSTRACT 



The military officer personnel system is modeled as a 
semi-Markov process. The probability distributions de- 
scribing state transitions are developed in terms of policy 
variables. Effects of changes in promotion policy and force 
size are studied for both a closed, steady state system and 
an open, transient situation. Moments of the joint distri- 
bution of officers in each rank are presented for all cases. 
A method for approximation of transient results from known 
distributions is formulated. 
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I. INTRODUCTION 



Personnel systems composed of a formal rank or grade 
structure that utilize a promotion procedure to move per- 
sons through or out of the system are commonplace in modern 
large organizations. In particular, the Officer Corps of 
each of the military services provides a. classic example 
of this type. 

Military officer promotions are controlled by federal 
laws such as the Officer Personnel Act of 1947 and the 
Officer Grade Limitation Act of 1954. Additional constraints 
may be imposed by service Secretaries, frequently acting as 
approving authority for the respective service's internally 
gene r at 0 u pro mo Lion pi an . 

Statutory ceilings, often further reduced by service 
policies, exist on the maximum number of officers holding a 
particular rank. Promotion boards meet annually to select 
officers for promotion to the next higher rank. Total num- 
bers to be promoted are established in accordance with pre- 
vious and projected attrition. The size of the promotion 
zone - those officers to be considered for selection - is 
based on a promotion opportunity parameter, e.g., 500 pro- 
motions might be obtained by a 50% opportunity from a 1000 
man zone, or by a 80% opportunity from a zone of 625. 

Time in grade - the number of years an officer has 
spent in his current rank - is a secondary cons ide ration in 
fixing the size of the zone. That is, the ma> ”ium speed 
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with which an individual may move through the system is a 
function of the size of the zone each year. 1 

Thus, there exist three policy variables, (1) total 
number in each rank, (2) promotion opportunity to next 
rank, and (3) time in grade, which control the functioning 
of the promotion system. 

The purpose of this paper is to present a mathematical 
model of the flow of personnel through this type multi - 
grade system and to study both long range effects of a given 
promotion policy and short term effects of a change in 
policy. The paper is written in four parts. In Part II 
we formulate a semi -Markov process model and define its 
variables and properties. Part III contains steady state 
results, and in Part IV we discuss transient results and 
derive a method to approximate them. 



i 

Accelerated promotions "below the zone" do occur. They 
account for less than 51 of the total promoted but will be 
included in all probability distributions disc issed in this 
paper. 
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II. MODEL FORMULATION 



Personnel flow models in which movement from state- to - 
state in successive time periods is assumed to follow a 
Markov chain have received considerable attention in the 
literature (e.g., Bartholomew [1], Gani [3]). An extension 
of a Markov chain model which accounts for some of the non- 
Markov properties of personnel systems is to model such a 
system as a semi -Markov process (S.M.P.), i.e., a process 
whose sequence of states forms an embedded Markov chain at 
the transition points, where the system changes state, and 
in which the lengths of time between these transitions are 
random variables (see Pyke [6]). 

Let us first formulate an ’’open model." That is, if 
state j, j = 1,2,..., 6, is the rank of an active military 
officer and state 7 is an absorbing state containing those 
officers who are retired, resigned, deceased or otherwise 
"out of the service," then ranks 1 through 6 are a set of 
transient states that form the "system." Persons leaving 
this set of states must be replaced by new recruits into 
the system if it is not to empty over time. Figure 1 il- 
lustrates movement in an open model. 

By controlling the input flow of new personnel we can 
control the total number in the system. If that control is 
such that in any time period the number of departures is 
equal to the number of arrivals, the number in the system 
remains constant. Since in this paper we beg i by studying 
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a system of fixed size (in Part IV this assumption is re- 
laxed) we can "close" (see Cinlar [2]) the model by arti- 
ficially closing the feedback loop shown as a dotted line 
in Figure 1. 
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Figure 1. Personnel Movement in Open Model. 

Now consider a system with 7 states, where state 7 is 
artificial and represents the absorbing state for those 
leaving active service and' from which a new recruit comes 
to enter the active states and replace the departing officer 
(although he does not necessarily enter the state from which 
the departure occurred) . 

As we shall see, the times taken to move from state to 
state in the model play an important role, and for states 1 
through 6 these times are dependent on policy decisions. By 
fixing the time to move from the artificial state 7 back to 
the active states at zero (instantaneous replacement) , we 
can remove state 7 from the system entirely and close the 
loop in Figure 1 without it. Thus we are lef with a 
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closed system of 6 recurrent, non-null states in our semi- 
Markov model. 

It is a system of this type which will be considered in 
this paper. We shall allow inputs to the system to occur 
only at rank 1. In Part IV we evaluate increases of overall 
size by new cohort inputs to the fixed size. 

We now pursue the system containing states 1, 2, 3, 4, 
5, 6, the officer ranks from 01 to 06. 2 As time passes an 
individual officer moves through the system from state to 
state. A transition occurs when he moves to the next higher 
state via promotion or when he leaves the service, in which 
case he returns to state 1 and is ’’replaced" as previously 
described. We now assume that the sequence consisting of 
points immediately following transition points forms a 
Markov chain. It is significant to note here that the va- 
lidity of this Markovian assumption is established by the 
special structure of the military promotion system ■* an 
officer either moves up to the next rank or he leaves the 
system. Thus knowledge of only the present rank provides 
complete information concerning the probabilities for the 
next transition. 

Times between transitions are random variables that de- 
pend only on the current state and the state to which the 



2 Rank/ Grade 
01 
02 

03 

04 



USA-USAF-USMC TITLE 
Second Lieutenant 
First Lieutenant 
Captain 
Maj or 



USN TITLE 



Ensign 

Lieutenant j . g . 



Lieutenant 
Li utenant 
C-.nmande r 
Commander 
Captain 



05 

06 



Lieutenant Colonel 
Colonel 



8 



transition will be made. Implicit here is the assumption 
that accelerated or delayed promotions do not affect later 
behavior . 

Formally then, consider the state space {1, 2, 3, 4, 5, 
6} 3 , the first six officer ranks. Let {Zj,(t) = i} be the 
event officer k is in rank i after a time t in service. 

Then the stochastic process (Z^(t) , t > 0} is a semi-Markov 
process (S.M.P.). The stochastic process that records the 
number of times the S.M.P. has entered each of the system 
states is called a Markov Renewal Process (M.R.P.), as named 
by Pyke [6,7]. The S.M.P. and the associated M.R.P. are usu- 
ally discussed together in the literature. However, the 
special structure of a personnel system is such that the 



following discussion will ce limited to the S.M.P. 



We shall assume that each officer in the system fol- 
lows an independent path from the same S.M.P. 4 If we let 
X j (t) be the number of officers in rank j at a time t, then 
{X(t) , t > 0} where X(t) = (X^(t), X 7 (t) , . . . , X^ ( t) ) ^ , is 
a multi-particle semi-Markov process generated by the S.M.P. 



We can now define 



QijCt) 
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process next makes a transi- 


process has 


tion into j and this occurs 


just entered 


in a time < t 


i _ 


- 

officer k next goes to rank 


he has just 


j and this occurs in a time 


attained rank 


< t 


i 



3 The state space could, of course, be ces 'ribed in gen- 
eral. It is limited to the specific case to discussed to 
simplify subsequent notation. 

4 See Heyman [4] definition of a Multi -part icle SMP. 
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state at time t is j 



P. . (t) = P 
ij 



process 
started in 
state i at 
time 0 



_( 2 ) 





= P 


officer's rank at time 
t is j 


o f f icer 
started in 
rank i at 
time 0 




= P [Z k (t) = j | Z k (0) = i]. 




F ij<° 
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a transition will occur 
in an amount of time < t 


process has 
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next enter j 




= P 


officer's rank will 
change in an amount of 
time < t 


i 

officer has 
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rank i and 
will next 
hold rank i 

-ji 


Hj (t) 


= P 


next transition occurs 
in an amount of time 
< t 


process has 
just entered 

i _ 




= P 


time officer spends in 
rank i < t 


he has just 
attained 
rank i 


G i:j Ct) 


= P 


first transition into 
state j occurs in a time 
< t 


process 
starts in i 

— 


should 


be noted that (t) does not have 


a meaningful 



(3) 



(4) 



(5) 



explanation in terms of the functioning of the officer sys- 
tem. However, its usefulness in the derivatior of further 
results merits its inclusion in the development. 
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Since (°°) is 
tion is into state j 
we define: 



the probability that the next transi- 
given the process has just entered i, 




(°°) 




so that p^ is the fraction of those who reach rank i who 
ever attain rank j . 

Denoting the matrix of j (t) by Q(t) [we will hence- 
forth use the notation Q(t) = (Q--(t))] we write 

0 0 0 0 



f?(°°) = 



q ll 

q 21 

q 31 

q 41 

q 51 
. 1 



P 1 2 
0 

0 

0 

0 

0 



P 2 3 
0 

0 

0 

0 



0 

P 34 

0 

0 

0 



0 

0 

*45 

0 

0 



0 

0 

0 



P 5 

0 



:>6 



( 6 ) 



where q. ^ = 1 - p ii+l the fraction of those who reach 
rank i but are never promoted to rank i+1 and are replaced 
by new officers in rank 1. 

It should be re-emphasized that this matrix defines a 
closed system - a system in which the number of officers N 
remains fixed with no extra entering or leaving the system 
over time. Thus, mathematically we have a certain fraction 
leaving each state and returning to state 1 with the inter- 
pretation of instantaneous replacement by a new officer. 

Recalling that Q i; (t) is the joint proba' ility of the 
next transition from i to j and in a time les^ than t we haw 
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Since Q..(°°) is the probability that the next transi 
tion is into state j given the process has just entered 1 
we de fine : 



QijM = Pij 

so that p t . is the fraction of those who reach rank i who 
ever attain rank j . 

Denoting the matrix of Q — (t) by Q(t) [we will hence 
forth use the notation Q{ t) = (Q—Ct))] we write 



Q(°°) = 



q ll 

q 21 

q 31 

q 41 

q 51 

1 



p 12 

0 

0 

0 

0 

0 



0 

P 23 

0 

0 

0 

0 



0 

p 34 

0 

0 

0 



0 

0 

P 45 

0 

0 



0 

0 

P 56 

0 



( 6 ) 



where q u = 1 - P ii+1 is the fraction of those who reach 
rank i but are never promoted to rank i+1 and are replaced 
by new officers in rank 1. 

It should be re-emphasized that this matrix defines a 
closed system - a system in which the number of officers N 
remains fixed with no extra entering or leaving the system 
over time. Thus, mathematically we have a certain traction 



leaving each state and returning to state 1 with the inter- 
pretation of instantaneous replacement by a new officer. 

Recalling that Q ij (t) is the joint proba' ility of the 
next transition from i to j and in a time les.> than t we liar 
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and thus 



Qii (t) Q^Ct) 
ij UJ qTTFT Pi ,• 






1J 



H 



6 6 
i(t) - y . pij F u c*> ■ I ‘Jijw- 

j=l j=l 



It can be shown (Pyke [6]) that 

6 t 

PijCt) - «ij [ i - H. ( t) ] * £ / p kP t ' x)dQ ik (x :> 

k=l o 



where 6.. is the Kroneker delta, 
ij 

If we let H. (t) = 1 - H. (t) and Q. . (t) * P, . (t) indi - 

1 1 1J KJ 

cate the convolution we obtain 



P. . (t'l 
ij 



6 

5. . H. (ti + V Q- . 

k=l 




1 >J 



1,2,. ...ft. 



The matrix form of these equations is 

P(t) = ff D (t)‘ + Q * P(t) (7) 

where P^(t) is a diagonal matrix of IL(t), and Q( t) * P(t) 
is the matrix convolution. 5 

A similar relationship between G^j (t) and (t) can 
be defined as 

6 t t 

G ij (t) = £ f G kj (t-x)dQ ik (x) + f l-G jj (t-x)dQ ij (x) (8) 
k=l o o 

with the matrix form 



S A convolution of matrix valued functions Is similar to 
matrix multiplication except the product of el.ments is re- 
placed by the convolution of elements. 
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(9) 



G(t) = Q * C(t) + Q(t) - Q * C D Ct). 

In terms o£ the policy variables of Part I we can now 
define (Ross [8]) the average amount of time spent in rank 
i as 

00 00 
p i = J t d H.(t) = J H.(t), 

o o 

and the average time spent in rank i given the next transi 
tion is to rank j 
t 

r ) . . = / t dF 

^ J 

o 



00 

u (t) "I 

o 



1 - 



Qiito \ 

p ij 



dt 



Finally, the mean first passage time from i to j is 



- ! 



‘J 



d G. . (t) 



for G . . (°°) = 1 . 
il v 



o 

Although the concept of first passage is of little direct 

use in this model, it should be noted that ( • ) is the 

distribution of lifetime in the system. For the most part 

however, G(t) will be used to derive other results which 

are in terms of the policy variables. 

In the officer promotion system we can consider Q(t ) 

(and thus tfp(t) , and p..)‘as known since the Q^-j(t) are 

i! il 

determined by promotion policies and officer behavior pat- 
terns. Parts III and IV will discuss the unknown P(t) , 
whose first row is of primary importance. NP^.(t), j = 
1,2,..., 6, gives the expected number of the N officers who 
are in rank j at time t. For large t, the P^ ; t) can be 
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interpreted as the fraction of officers expected to be in 
rank j. Thus, to evaluate the long term effect of a given 
policy, the limiting form of P(t) is required and its deter- 
mination directly from (7) is formidable. The introduction 
of the distribution G(‘) and in particular (9) will simplify 
the task. 

Measurements of the limiting form of P(t) could, of 
course, be done directly via a cohort type model (e.g., 
Marshall, [5]), but these direct measurements do not give 
any information as to how changes in policy affect the 



III. STEADY STATE RESULTS 



Let us first examine the output of this model after a 
long period of time; that is, in the steady state. 

In the steady state, the limiting form of P(t) contains 
the distribution of the N officers over the 6 states. We 
shall see that its solution is indirectly in terms of pol- 
icy variables and will illustrate how the effects of pol- 
icy changes can be measured in terms of the parameters of 
the model . 

Defining the Laplace Stieltjes Transform (L.S.T.) of 
the function F as 



00 



F (s) 




s > 0 



o 



we solve simultaneously equations (7) and (9) . 
First, taking transforms of (7) we obtain 



P(s) = # D (s) + Q(s) PCs) , 



( 10 ) 



which can also be written 



[I-Q( s)]' 1 = P(s) P D (s) 



(ID 



Likewise, transforms in (9) yield 



G(s) = Q(s) - 3(s) C D (s) + Q(s) G( s) 



( 12 ) 



which can be simplified to 



[J-S(s)]' 1 = J + G( s) (I-G d (s)) 



(13) 



Equating (11) and (13) we have the result 




P(s) = P D (s) + G( s) A d (s) 



(14) 
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A 

where 4p(s) is a diagonal matrix with elements 



H.(s) 

( s ) 

To analyze the steady state results we now find lim P(t) 

~ t->-°° 

or equivalently the lim P(s) . Thus, 

s->-0 

A A /\ A 

lim P(s) = lim Pi^s) + lim ff(s) lim 4 D (s) = 0 
s->0 s->-0 s->-0 s->0 



+ J lim 
s-*-0 



H^s) 

(s) 



where 1 is a 6x6 matrix of l's. 

Now, using L'Hospital's rule we see that 



H 6 (s) 



C 66^ 



H.(s) 

lim 3 

s +0 G. . (s) 
n v J 



= lim 



(S-) 



y, 



s +0 G.' . (s) 

li J 



li 



so that finally we can say 



1 ini P(t) = lim P(s) = 

t-^oo S+0 



y l 


y 2 


y 6 


y ll 


y 22 


y 66 


y l 


y 2 


y 6 


y ll 

• 

• 


y 22 


y 66 


• 

y l- 


y 2 


y 6 


y ll 


y 22 


y 66 


also 


Ross [8]) th 


terms 



( 15 ) 



row of this matrix of limiting probabilities as 
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P. = lim P..(t) = -J— , j = 1,2,.. .,6, (16) 

J t+°° 1J y jj 

that is, in the steady state the fraction of officers in rank 
j equals the ratio of expected time in rank j to expected 
recurrence time from rank j back to j . 

However, since it was previously noted that, with the 
exception of U-q ’ the have no recognizable meaning with- 

in a personnel system structure it is desirable to develop 
an expression for P^ ..(<») = Pj which is in terms of policy 
variables . 

Consider the embedded Markov chain and the long run 
proportion of transitions into each rank j; that is, the 
solution vector {IK , j = 1,2, ...,6} to 

n — n q (<») . 

Using Q(°°) as structured in (6) we arrive at 
11 i = 6 i-1 

i ♦ I It 

j = 2 k=l 

£ - 1 
TT 

it =— — rr t — 7— £ = 2,3,... 6. 

£ 6 j -1 

1 * I TT p k,k*i 

j = 2 k=l 

It can also be shown 6 that 



6 These results on the expression of P. in terms of it. 
are due to Ross [8], pp. 104-105. * 
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w ij - v i+ Y, Pi 

k^j 



k y kj 



and combining this with P. = y./y.. we have 
6 3 3 3 3 

p . = - J J. 



J 1 , 2 , . • • 6 . 



j f 

i=l 

By substituting the values of IK derived above we obtain the 
key result 



P. = 
1 



• tt 

l k=l ^k,k+l 



i - 1 



3 = 1,2, ... ,6 (17) 



'i + E p i TT Pk.k.i 



i=2 k=l 



where the numerator of P, is defined as y, . Hence, equa- 
tion (17) is an expression for the fraction of officers in 
the system that are in rank j in the steady state, in terms 
of mean times in grade and .elements of £(°°) - six y^ and 

five p... Thus each P. is a function of at most eleven 
3 3 

parameters, but can be computed without use of the detailed 
structure of Q^. (t) or H^(t) . 

It is interesting to note the effect of parameter 
changes in (17) . For any j it is easy to verify that when 
P^ + ^ is increased(decreased) : 

Pj incre ases (decreases) i < j 

Pj decreases (increased) i > j. 

To evaluate the sensitivity of Pj to chan ^s in a par- 
ticular y. , let us first consider the case of a change of a 
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specified amount. The denominator of (17) 



y l +y 2 p 12 +y 3 P 12 P 23 +y 4 P 12 P 23 P 34 +y 5 P 12 P 23 P 34 P 45 

+y 6 P 12 P 23 P 34 P 45 P S6 



then is affected most by a change in y^ , since the coeffi- 
cients of p. i = 2,.. 6 are less than unity. Similarly, 
becomes less sensitive to this type change in y^ as i in- 
creases from 1 to 6. However, if a percentage change in a 
y. is considered then the actual values of the y. and p.. 

l l *ij 

will determine the y. to which P. is most sensitive. For a 

1 J 

set of parameter values that approximate current policy in 
all military services, y 9 is the most critical parameter 
for percentage change analysis. 

The case where all y^=y and all p^=p provides further 
insight into the effect of parameter changes. Here (17) be- 
comes 



P. 

3 



y 



j - 1 
y p J 
5 

* Z u p 1 ’ 1 

i=2 




5 



which shows that in this special case P^ is independent of 
y. Figure 2 gives the plot of Pj versus j for various values 
of p . 



Returning to the concept of the MSMP (Multiparticle) we 
can now consider the joint distribution of the number of of- 
ficers in each rank. Since P^ is the probability of reaching 
state j in a single trial, and the movement of 'ach officer 
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is an independent path, the joint distribution is multi- 

T 

nomial ; that is, X(~) = (X x ,X 2 , . . . ,Xg) is distributed 

T 

multinomial with parameters N and P where P = [P^ ,P£ , • • • »Pg ] > 
a row from P (°°) . 

Thus , 

6 
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I h 


= N 


(18) 
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are not 


independent , 


but are 


negatively 



correlated such that 
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) 



P(X d ,Xj) 



i 1 



/(l-P i jCl-P j ) 

For large N the distribution of X(°°) is approximately 
multivariate normal. Thus the distributions of each X^ are 
approximately univariate normal with mean and variance given 
by the appropriate elements of the mean vector and covariance 
matrix above; e.g.. 



NP. 



/NP 3 Cl-P 3 r 



*( 0 , 1 ) . 



This enables us to make probability statements about the 
number of officers in any rank in the steady state. 

Returning to the. simplified case of just two parameters, 
we illustrate the correlation between the numbers of officers 
in two different ranks. Namely, for p = .7 



p(x 3 ,x 5 ) = • 



P 3 P 6 



/r^pprwv 

= -. 021 . 



Thus, the effect of a change in the number in rank 3 on the 
number in rank 6 (and vice versa) is small. 

It is not the purpose of this paper to describe de- 
tailed methods of finding the distributions or estimating 
the parameters used in this model. It must be noted, how- 
ever, that the y^ and p^j are not themselves the policy 
variables of a personnel system as described in Part I, but 
rather are functions of those policy variables The p^. 



22 



represent the fraction of those that enter rank i that go 
on to rank j . They say nothing about attrition that removes 
officers from the system (sends them back to rank 1) prior 
to their consideration for promotion. For example, consider 
P 23 « Let us assume that the expiration of tours of obligated 
service (EOS) for a group of officers occurs during the time 
they are serving in rank 2. If 2/3 leave the service at 
EOS or before with terminal grade 2, only 1/3 are later con- 
sidered for promotion to rank 3. If the promotion opportu- 
nity to rank 3 (for that 1/3) is .9, then we may approximate 



From the discussion in Part II on the various moments 
used in the model, it can be seen that 

6 



next rank is to be j. For each i the summation in (20) con- 



expected time in grade of those to be promoted to the next 
rank, might be considered an actual policy variable. The 
n i;L are consequences of decisions on the n^ + ^, promotion 
opportunity, and the various other forms of attrition. As- 
suming three years in grade 2 before promotion, 1.5 years 
in grade 1, three years obligated service, and p^ 2 = -30 we 
may approximate 



p 23 = (.33) (.9) = .297. 





y 2 = (.70) (1.5) + (.30) 3 = 1.95. 
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To conclude this section let us consider a more com- 
plete example of this steady state analysis using a set 
of parameters developed from the above thoughts and rough 
approximations to current military policies. 

Let 



y-L = 1.5 


P 12 


.95 


v 2 = 2 


p 23 


.3 


= s 


P 34 


. 8 


> , 4 = 5 


P 45 = 


. 75 


U 5 - 6 


P 56 = 


. 6 



p 6 = 7 

Using (17) we calculate the fractions expected in each rank 
in the steady state. Table I presents these results, the 
long term effect of increasing to six years, and the 
actual 1971 distribution in the U. S. Marine Corps for com- 
parison . 7 



TABLE I. FRACTIONS IN RANK 



Rank 


Approx . 
Parameters 


Increased 

y 4 


Actual 

USMC 


1 


.195 


.188 


.132 


2 


.247 


.239 


. 319 


3 


.185 


.180 


.275 


4 


.147 


.171 


.159 


5 


.133 


.128 


.080 


6 


.093 


.094 


.035 



From (19) and the above results it follows: 



7 Source of the Marine Corps data is Combined Lineal 
List of Officers on Active Duty in the Marine Corps. 

1 January 1971, NAVMC P-1005-PD. 
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V[X(oo)] = N 



.157 


- .048 


-.048 


.185 


-.036 


- .046 


- .029 


- .036 


- .026 


- .033 


- .018 


- .023 



- .036 


- .029 


- .046 


- .036 


.151 


- .027 


- .027 


.125 


- .025 


- .018 


- .017 


- .014 



- .026 


- .018 


- .033 


- .023 


- .025 


- .017 


- .018 


- .014 


.115 


- .012 


- .012 


.084 



Inspection of the covariance matrix shows V(X^) as the 
largest and V(X^) as the smallest. However, from Table I 
we note that the numbers of officers in ranks 2 and 6 are 
largest and smallest respectively. To provide a more valid 
comparison of the variation in each of the ranks, we employ 
the coefficients of variation: 




✓NP • (1-P • 
2 2 
NP. 

2 



Using N = 20,000® these coe.f ficients were computed using the 
results from the approximate parameters and are listed in 
Table II. This table also lists for each X^ the interval 
extending two standard deviations on either side of the mean 
in which we expect .955 of all realizations to fall. 

Thus, we may conclude that when normalized by the num- 
ber of people in that rank, the variation is greatest in 
rank 6 and decreases as j decreases to 2. This is, of course, 
intuitively appealing since the officers in state 6 have ex- 
perienced the largest, number of state transitions. 



®1 Jsnuary 1971 U. S. Marine Corps total was 21,320. 



TABLE II. MEASURES OF VARIATION 



Rank 


Coefficient 
of Variation 


np.±2/nf: 

1 J 


(1-Pj) 


1 


.014 


3900 


± 


112 


2 


.012 


4940 


+ 


121 


3 


.015 


3700 


+ 


109 


4 


.017 


2940 


+ 


100 


5 


.018 


2660 


+ 


96 


6 


.022 


1860 


± 


82 



This completes 
following section, 
crease or decrease 
system and evaluate 



the remarks on the steady state. In the 
we shall consider the effect of an in- 
in the total number of officers in the 
transient results. 
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IV. TRANSIENT RESULTS 



Realistically, a graded personnel system which under- 
goes even occasional policy changes never actually reaches 
a steady state. Thus, analysis of the transient reaction 
of the system to a given policy change is necessary if the 
effects of such a change are to be well understood. 

In (2) we defined P^ft) as the probability an officer's 
rank at t is j , given he started in i at time zero. Through- 
out this paper we have assumed that $(t) can be constructed 
from known data and can be considered as given. Even so, 
the direct determination of P(t) appears to be a difficult 
task. Hence, it is desirable to develop a method to "ac- 
curately" approximate P(t) . 



The relationship bet\s'een P(t) and Q( t) was stated in 
(7) as 



and taking Laplace Stieltjes transforms and revrriting (11) 
we obtain 



P(t) = P D (t) + Q * P(t) , 



CO 




n=0 



so that, after inverting, 



oo 




( 21 ) 



n=0 



\'/here Q^(t) is the nth fold convolution of Q t) with it- 
self and <2^^(t) = I. 
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Since the expression for P( t) in (21) requires the 
matrix convolution of Q( t) with itself for all n = 1,2,3,... 
we seek simpler expressions which give bounds or approxima- 
tions to p (t) . 

First, 1 is certainly an upper bound for P^j (t) . If 
we substitute P(t) = 1 in the right hand side of (7) we can 
write: 

P(t) < P D (t) +<2*2- P D (t) + P( t), 

where tf(t) is a matrix whose ith row contains elements fk(t). 
A second iteration, substituting the right hand side above 
for P(t) yields 

P(t) < fl D ( t) + Q * [fl D (t) + P(t)] 

< fl D (t) + [Q * P D (t)j + [Q * P(t) ] , 

and by continuing this process, we have after n+1 iterations 

n 

P(t) < Y, $( ‘ k ' ) * + Q ^ ' (22) 

k=0 

As n-*- 00 the term Q (t) ->-0 so that this iterative process 

does converge to P(t) as defined in (21) . 

Certainly, Pjj(t)>0, and an identical iterative cal- 
culation shows that 

n 

P(t) > Y <2°° * V t} * (23) 

k=0 

Thus, by combining (22) and (23) we have 

n 

0 < P(t) - Y <2^ * < $ (n+i;) * 1. (24) 

k=0 
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By choosing n large enough we can estimate P(t) by 



n 




k=0 



* P D (t) 



to any desired accuracy. 

In Part II a system of constant size N was considered 
and no changes in total size over time were investigated. 

Let us now consider an increase in total size generated by 
increased inputs into state 1, i.e., the number of new re- 
cruits to the system exceeds the number departing from the 
system in a time period. This may be done on a one-time 
basis at a time we shall call zero, or by adding different 
amounts each year for several successive years, starting at 
time zero. Figure 3 depicts this type increase. 

Let n(t) = the number added at time t which are in 
excess of those needed to replace departures from the system. 
Then N(t), the total system size at time t may be defined 
as 



N(t) 




(25) 



This system is still "closed" and the concept of immediate 
replacement of departures applies for the entire N(t). If 
we assume the original system of N officers was in the steady 
state at time zero, the analysis of that group can be con- 
ducted as discussed in Part III. To derive information 
concerning the entire system we can superimpose the tran- 
sient results of the added cohorts onto the oi ginal system 
results . 
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ADDED SIZE 
DUE TO 
INCREASE 



\ 

n(2) I 



1 n (l) 



n (1) 






n (0) 



n(0) 



n (0) 

/ 




Figure 3. Size Increase. 

Let Yj (t) be the number of officers from those extra 
cohorts added at time zero and after that are in rank j at 
time t. Thus 

Y ( t) = [YjCt), Y 2 (t),...,Y 6 (t)] T . 

Similarly define Sj (t) and the vector S(t) for the total 
system. Then 

t 

E[Y j (t)] = Z n(t-u) p ij (u) (26) 

u=0 

and the vector of expected numbers of officers in the total 
system that are in the various ranks at time t is given by 
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E [S (t) ] = E [X (°°) ] + E [Y (t) ] 



NP x + E[Y 1 Ct) ] 
NP 2 + E [Y 2 Ct) ] 



( 27 ) 



NP 6 + E[Y 6 (t)] 

_ _ 

We see that to calculate (27), E[Yj(t)] is needed, and from 
(26) this requires knowledge of P^ j ( u ) , u < t. These Pjj(t)'s 
can be approximated by (24) . 

As discussed previously, the joint distribution of the 
number in each rank at time t for a particular cohort input 
is multinomial. By assumption, each cohort is a MSMP which 
is independent of all other cohorts. Thus 



V 



[Yj (t) ] = £ n(t-u) P lj (u)(l-P. j (u)) > 



(28) 



u=0 



and 



COV[Y i (t),Y j (t)] = - £ n(t-u) P n (u) . (u) . (29) 

u=0 

Forming the covariance matrix V[Y(t)] from (28) and (29) 
it follows that 



V[S(t)] = V[X(«)] + V [Y (t) ] . (30) 

To measure the effect of policy changes in the transient 
case, we must first translate these changes in o a new $(t) . 
Then, using (24), we can estimate P(t). If policy changes 
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and an increase in overall size are to be effected simultan- 
eously, we can consider the entire system to be non- stationary 
and revise (26) to 

E[S(t)] = E [W (t) ] + E[Y(t)] 

where 

o 

E [Wj (t) ] = £ NP i P.^t), j = 1,2,. ..,6. 
i=l 

Similarly, P^ (t) replaces P^ in all calculations for V[X(t)] 
which is subsequently used in a revised (30) . 

The next case to be considered is a decrease in overall 
size, initiated by a decrease in the number of new officers 
entering rank 1; that is, the number of officers leaving 
the system in a time period is greater than the number of 
replacements. This may be viewed as merely a diminished 
recruiting input to gradually reduce size, or as forced at- 
trition in the higher ranks with a revised Q(t) that causes 
more "departures" to state 1, where "replacement" is no 
longer on an instantaneous one-to-one basis. A major force 
reduction would undoubetdly be a combination of both policies. 

Let the size of the officer corps prior to time zero be 
N, and assume steady state conditions. Let N' < N be the 
desired new size. Then a system of size (N-N') must be 
emptied to reach this objective size. Figure 4 depicts this 
process . 

At time zero we establish a subsystem of size N', whose 
members are chosen randomly such that the proportions of 
officers in each rank are equal to those of th larger size 
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Figure 4. Size Reduction. 

N system. These N* officers will proceed in the previously 
defined closed system model - in either the steady state or 
transient mode, as appropriate. However, the (N-N') other 
officers are placed in an open system, where state 0 is de- 
fined as "out of the service." Distinguishing the open sys- 
tem by *, we have then Q*(t) for this open portion as: 





0 


0 


0 0 


0 


0 


0 




Q i0 C 1 ) 


0 


Q 12 (t) 0 


0 


0 


0 




^20 ^ 


0 


0 Q 23 (t) 


0 


0 


0 


e*(t) = 


q 30 (t) 


0 


0 0 


Q 34 ^) 


0 


0 




q 40 ^ 


0 


0 0 


0 


Q 45 C t) 


0 




q 50 (t) 


0 


0 0 


0 


0 






Q 60 


0 


0 0 


0 


0 


0 


For this sub-system, 


Hfl(t) 


- J % ct) = 


0. Thus 




= 1 



and using the approximation (24) we can estima s p*(t). As 
t -* 00 the limiting form of P*(t) is given by 
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lim P*(t) 



1 0 0 0 0 
1 0 0 0 0 
1 0 0 0 0 
1 0 0 0 0 
1 0 0 0 0 
1 0 0 0 0 
1 0 0 0 0 



0 0 
0 0 
0 0 
0 0 
0 0 
0 0 
0 0 



Thus, the expected remaining number in rank j, 
E[Rj(t)], in the open system can be calculated using the 
transient part (states 1 through 6) of P*(t); i.e., 



6 

E[Rj(t)] = £ (N-N') P i PJjCt). 

i=l 



AS 



p |j(t)->0 rank j empties to zerc 






:he expected 



number in the open subsystem, shown as the shaded area in 
Figure 4, decreases to zero and the total objective size 
N' is reached. Considering' the system as a whole, we have 



E [Sj ( t) ] = £j- E [Wj (t) ] + E [Rj (t) ] ; j = 1,2,. ..,6. 

To conclude this section, we note that a logical next 
step in the utilization of this model is the construction 
of £(t) from actual policy and data. For example, consider 
a simple development of Q^j(t). Let 



a = attrition rate from rank 1 due to death, disability, 
dismiss al , etc . , 

3 = opportunity for promotion. 

T = time in grade 1 until promotion atterv'C 

EOS :■ T. 
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Then, 

Qll Ct) = Qf 0 (t) = 1 - (1 -a) ^ t <T 

= l-(l-a) T +(l-6) (l-a) T [l-(l-a) t ' T ] t<E0S 
= 1 - (1 - a) T 0 t>EOS 

Q 12 (t) = Qf 2 (t) = 0 t<T 

= e(l-a) T t>T 

Q (t) may then be substituted into (24) to obtain an 
estimate of P(t) . Analysis of estimation errors involved 
and the number of convolutions necessary to achieve the 
desired accuracy can then be conducted. 
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